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(54) Information access system and method for providing a personal portal 



(57) The present invention presents a system and 
method of providing information retrieved from a server 
(30) from across a communication network that has 
been personalized with private information that is not 
disclosed by the server (30). The document is retrieved 
from the server (30) via a standard document serving 
protocol channel. Before serving the document to the 
client, the private information is retrieved from a local 
storage device and merged with the information in the 



document to produce a customized document. In a pre- 
ferred embodiment of the present invention, the process 
is implemented by a proxy server or a client-side proxy 
server connected to a standard conventional browser. 
The proxy server can provide filters and a scripting serv- 
ice to make the process of customizing the information 
transparent to the normal document serving protocols. 
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Description 

Reld of the Invention 

5 [0001 1 The present invention relates generally to Information access systems, and, more particularly, to information 
access systems used to retrieve information from across a communication network. 

Background of the Invention 

10 [0002J As more resources become available on communication networks such as the Internet, it has become 
increasingly more difficult to locate, manage, and integrate them. Many information retrieval clients such as the brows- 
ers by Netscape, Microsoft, and Mosaic have been introduced to make searching and retrieving information on the net- 
work more convenient and productive for end-users. Unfortunately, the closed architecture of such browsers has 
rendered the software design overloaded arxJ monopolistic. Customizing the information retrieval process is difficult if 

15 not impossible. 

I0003J For example, it would be advantageous to personalize information received from many centralized web sites. 
Recently on the Internet there has been a heated competition among several companies to establish "portals": websites 
that assemble an array of services and contents to attract internet users. The consensus is that there will be only a few 
portals through which most customers access services and products on the internet. Therefore, the most popular por- 

20 tals is likely to reap top advertisement dollars and E-commerce transaction fees. Existing portals such as "My Net- 
scape" (http://my.netscape.com), "Excite" (http://my.exclte.com), "My Yahoo" (http://my.yahoo.com), are loaded with 
similar features such as search engines, stock quotes, maps, weather information, and news. However, most of these 
services have become commodities that you can obtain through companies like Infospace (http://www.infospace.com). 
Portal builders have been busy creating new services in a hope to retain existing customers. Recent examples include 

25 AOL's "Instant Messenger" and Netscape*s "Smart Browsing" and "WebMail". 

[0004] Many of these new services attempt to collect a user's profile information and detect the users presence on 
the Internet so as to create direct marketing channels to the user. However, none of these new services has the ability 
to combine the rich contents from the portal server with sensitive and private information on the client side to provide a 
truly personal experience. For example, imagine that a user would like to get a list of stock quotes from the server and 

30 combine that with local stock portfolio information to compute the net gain/loss and display the information on the per- 
sonal portal. The user may not want to give his or her financial details to the portal server, but this is required by all por- 
tal implementations. 

Summary of the Invention 

35 

[0005] The present invention presents a system and method of providing information retrieved from a server from 
across a communication network that has been personalized with private information that is not disclosed by the server. 
The document is retrieved from the server via a standard document serving protocol channel. Before serving the doc- 
ument to the client, the private information Is retrieved from a local storage device and merged with the information in 
40 the document to produce a customized document. In a preferred emtXKliment of the present invention, the process is 
implemented by a proxy server or a client-side proxy server connected to a standard conventional browser. The proxy 
server can provide filters and a scripting service to make the process of customizing the information transparent to the 
normal document serving protocols. 

[0006] These and other advantages of the invention will be apparent to those of ordinary skill in the art by reference 
45 to the following detailed description and the accompanying drawings. 

Brief Description of the Drawings 

[0007] 

Fig. 1 sets forth a diagram of an information access system and method illustrating an embodiment of the present 
invention. 

Rg. 2 sets forth an example of a system architecture illusti-ating an embodiment of the present invention. 
Rg. 3 sets forth a list of system commands that can be invoked using URL extensions. 
55 Rg. 4 sets forth a screenshot of an exannple service menu. 

Rg. 5 sets forth a list of commands that can be invoked using HTTP extensions. 

Rg. 6 sets forth a diagram illustrating the use of filters with an information access system and method. 

Rg. 7A, 7B and 7C set forth examples of cgi-bin filter programs. 
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Fig. 8 sets forth a list of scripting commands that can be used with a document pre-processing system. 

Fig. 9 sets forth arguments for use with a javabin class invoked by the "block" and "javabin" commands in Fig. 8. 

Fig. 10 sets forth a diagram illustrating the use of archiving with an information system and method. 

Fig. 1 1 sets forth an example of a grep class for use with a walking fadlity. 
5 Fig. 12 sets forth a screenshot of an example cron menu. 

Fig. 13 sets forth a screenshot of an example archiving menu. 

Fig. 14 sets forth a diagram illustrating the use of multiple archiving repositories. 

Fig. 15 sets forth an example of scripting directives embedded in an HTML comment. 

Fig. 16 sets forth a screenshot of an example personalized portal. 
10 Fig. 17 sets forth a screenshot of an example prior art portal displaying financial information. 

Fig. 18 sets forth a screenshot of an example personalized portal. 

Detailed Description 

15 [0008] Fig. 1 shows a diagram of a communications system which is suitable to practice the present invention. In 
the exemplary embodiment shown, a proxy server 30 is connected to a communication network through communication 
link 200 to a gateway 90. The proxy 30 is shown shared by a number of clients 60 who are each executing an informa- 
tion retrieval program such as a browser. In an afternate embodiment, the proxy and the client browser can be executed 
as processes on the same client machine. Servers 70 provide information content to the clients 60 utilizing some doc- 
20 ument serving protocol, such as the Hypertext Transfer Protocol (HTTP) as described in T. Berners-Lee et al., "Hyper- 
text Transfer Protocol - HTTP/1.0." RFC 1945, Network Working Group, 1996. which is incorporated by reference 
herein. As used herein, a document serving protocol is a communication protocol for the transfer of information between 
a client and a server. In accordance with such a protocol, a dient 60 requests information from a server 70 by sending 
a request to the server and the sewer responds to the request by sending a document containing the requested Infor- 
ms mation to the server. Servers, and the information stored therein, can be identified through an identification mechanism 
such as Uniform Resource Locators (URL), as described in detail in T. Berners-Lee et al.. "Uniform Resource Locators." 
..RFC 1 738. Network Working Group, 1 994, which is incorporated herein by reference. In an advantageous embodiment, 
the network is the Internet and the sewers 70 are Web sewers. 

[0009] Proxy sender 30, as is known the art, has a processor 140. memory 130 and a non-volatile storage device 
30 1 50 such as a disk drive. The memory 1 30 includes areas for the storage of, for example, computer program code and 
data, as further described below. The proxy server 30 is shown executing two processes: an access server 40 and a 
web server 50, both of which are further described in the pending utility patent application, ^'Information Access System 
And fy/lethod," Serial No. 08/994,600, filed on December 19, 1997. The access server 40 behaves like a typical proxy 
server and accepts document requests (in a preferred embodiment, using standard TCP ports and HTTP) and routes 
35 them to other proxies or the desired server. The built-in server 50 is designed to act as a function execution engine 
rather than just an information provider 

[0010] Fig. 2 illustrates an exemplary system architecture, adapted for HTTP and implemented as Java classes, 
providing the functionality necessary to practice an embodiment of the present invention. When the proxy application is 
started, the main thread 2010 listens on the proxy port and receives and responds to HTTP requests from clients 60 

40 (browsers or other proxies). The system creates a new User Thread 2020 to serve each new request. The iserver class 
2025 parses the client's request and forwards commands to iagent 2035 for remote web access or to ihttpd 2026 for 
localhost access. The iserver class 2025 also implements various protocol extensions further discussed below in Sec- 
tion 1 . The ihttpd class 2026 implements the web server described above and will return an external file with the http 
header or execute a local CGI script to generate the replying message online. If the content is in a special scripting for- 

45 mat described in further detail below in Section 3, icmd 2028 will be invoked to parse the script and interpret and exe- 
cute any commands embedded in the document page. 

[001 1 ] The iagent class 2035 of the agent thread 2030 connects to a remote web server 70 or proxy to request a 
Web page, iagent 2035 can cache the page and return the page to iserver 2025 or to ihtwalk 2045, a facility to walk the 
html free structure to collect and archive pages. The ihtwalk class facility.is further described below in Section 4 in the 
50 desaiption of the walking facilities. 

1. Protocol Extensions 

[001 2] The URL and HTTP protocols can be extended to include additional system commands that advantageously 
55 permit conventional information retrieval clients to be utilized with embodiments of the present invention. This can be 
accomplished in a manner that is transparent to the client browser application and, thus, requires no new user interface. 
[0013] As an illustration of an example format for a URL extension Is: 
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URL? iproxy&command 

where "? iproxy" is a keyword, and "command" is a service that might be applied to a given URL or a system command 
that is irrelevant to the given URL For example, the command could invoke a archiving service (as described in further 
5 detail below in Section 5) or can be used to tailor system functions. The iserver class 2025 parses the commands and 
fonwards the command to ihttpd 2026 which, in turn, forwards the command to icmd 2028 for processing. Fig. 3 sets 
forth a variety of system commands that can be defined using URL extensions. 

[001 4] In another embodiment of the present invention, a URL extension can be used to invoke a dynamically gen- 
erated menu of entry points for available services and present it to the user's browser when requested. For example, 
10 the URL naming protocol can be extended by introducing a new naming scheme: 

URL?? 

where the double-question mark "?T is a trigger to invoke a service menu. ITie service menu can be implemented to 
75 inherit the same cookies as the current URL. The proxy subsystem intercepts the request from the browser with the 
above request pattern, generates a menu on-the-fly and returns the menu to the browser as an HTML file. Fig. 4 shows 
an illustrative example of a menu obtained after a user browses a webpage, here "http^AAww-interac- 
tive.wsj.conVpages/techmain.htmr, and types "??" after the URL and presses enter. The menu platform defines 
entries a number of services and user-defined macros on a per URL-set basis. For example, Fig. 4 permits the user to. 
20 inter alia, change cache policies, archive or prefetch pages in the html tree, or search the page hierarchy for a keyword. 
The menu system chooses the proper menu description based on the cunrent URL 

[001 5] The menu service has numerous advantages. It does not introduce a new graphical user interface, but rather 
presents the menu in HTML content shown in normal browsers. It preserves user's cookies and is easily extensible. 
New service entries can be readily plugged into the menu. The concept of the service menu is akin to pushing special 

25 keys during a traditional telephone conversation, for example, "##*' - the network then places the line on hold and 
announces a service menu for selection: after menu selection, the line is placed back to the original conversation. 
[0016] New commands can also be introduced to HTTP for special communications among multiple proxy servers 
to. for example, establish special connections (like persistent channels) and/or perform value-added services (like TCP 
forwarding). For example, the commands set forth in Fig. 5 can be defined for such comhiunications and used to extend 

30 the conventional HTTP commands. 

2. Filters 

[0017] Support is provided for the processing of data by filters. Fig. 6 illustrates how filters can be applied to http 
35 headers, pages returned from the web. and pages returned from a local cache. For example, an input filter can be used 
to add new conoponents (menubars, etc.) or modify returned pages (replace some remote data with local data, etc.). 
Data from servers can also be condensed, compressed, enaypted, patched, etc., prior to the corresponding filters con- 
verting it back into its original format before returning it to a user. 

[0018] The filter functions shown in Fig. 6 can be specified in a configuration file for the proxy's built-in web server. 
40 The function can be specified with a corresponding URL pattern, such that the filter is applied to URLs matching the 
pattern. For example, the following entries: 

InputFilter /bin/f paclc.cgi http : //*/resume . litml 

45 

OutputFilter /bin/f unpack. cgi http : //*/resume,html 
HeaderFilter /bin/f oirward. cgi .http://www.att.com/* 

50 ' . .■ 

specify cgi functions for the indicated filters and URL patterns. As indicated in the HeaderFilter entry, all HTTP calls for 
the web server www. att. com will be processed by the cgi function fonward.cgi before being sent out to the remote web 
server (or proxy server), and so on. Filters can also be specified using an extended URL command. For example, the 
system can be configured to calls filters with the arguments: 

55 

httpy/localhost/javabin/inputfilter?url=:cached_url&path=cacheJile 

httpy/localhost/javabin/outputfilter?uri=cached_url&path=cache_file 

httpy/localhost/javabin/headerfilter?htheader=headerJines 
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[0019] Filter programs can be implemertted as cgi-bin programs and inherit the cgi-bin API. Every filter programs 
implemented as a Java class will create an instance when invoked. Figs. 7A, 7B, and 7C show example cgi-bin filter 
programs. Fig. 7A shows an inputfilter. the Execute method reading the "cachejile" and updating the file if necessary. 
In Fig. 7B, outputf ilter uses "cachejile" as input and sends the result to OutputStream which will be sent back to the 
5 original caller. Fig. 7C shows headerfilter which gets the original http header (multiple lines without the empty line) from 
Hashtable. and outputs a new header to OutputStream. 

3. Scripting Facilities 

10 [0020] In addition to Java class invocation mechanisms ard standard scripting mechanisms such as Ksh and Perl, 
it is advantageous to provide support for document pre-processor scripting. Proxy-side scripting allows the different 
system components to be integrated in a light-weight manner that has a syntax and a semantics that is very HTML-like. 
Scripting provides a method for plugged-in services/functions to access built-in functions, server status and data struc- 
ture, and the cache. A scripting proxy preprocessor can also provide a communication media for multiple proxy servers. 

15 [0021] The inventors devised a scripting language providing extra macros statements based on the standard doc- 
ument markup language HTML The proxy server pre-processes the scripts and turns the comments into pure HTML. 
In a preferred embodiment of such scripting, it should include support for variable declarations, conditional statements, 
sets of built-in functions, and interfaces to invoke cgi-bin. The script can be a standard HTML-like plain text file that con- 
tains the macro statements. In order to identify the document as a script, an identifier should be included; for example, 

20 the first line in the script can start with: 

# ! / iproxy/script 

The arguments of a cgi-bin can be accessed using "$ {arg}" inside the script file. Rg. 8 sets forth a list of built-in state- 
rs ments that are useful for scripting. When using the "iblock" and "ijavabin" commands, the script will invoke a javabin 
class with the arguments set forth in Fig. 9. 

4. W alking Facilitie s . - 

30 [0022] One useful facility is a basic function supporting a mechanism to walk through document page hierarchies. 
This is similar to what Tind" and "tw" (file tree walk) do on Unix file systems. The walking action is specified by a root 
URL where the action starts, a specification of how many levels the action will visit, and certain additional properties 
such as whether or not image files should be included. For each visited page, one or more of a list of functions can be 
invoked one by one to perform tasks on a cache of the page. Examples of such functions include functions for archiving 

35 the web pages, searching for keywords, and creating index tables. 

[0023] See Fig. 10 forte structure of a walking function, "htwalk", designed in accordance with a preferred embod- 
iment of the present invention. The syntax for the walking function is given in Fig. 3. For exanple, for the URL 

httpy/www.att.com/?iproxy&htwalk=3, -local, -image,archive,grep=Cable 

40 

the system walks down 3 levels for pages referred (directly or indirectly) by www. att.com, including image files, but only 
for those pages on the local server. For each visited page, the system calls the function archive to archive the page and 
the function grep to search for the keyword "Cable" in the page. For each visited page, the system calls the following 
cgi-bin programs one-by-one: 

45 

/bin/archive.cgi ?url=visited jDage&args=int_no, -local&path=cached_f ile &htwalk=archive 
/bin/grep.cgi?url=visitedj3age&args=int_no. -local&path=cachedJile &htwalk=grep&walkopt=Cache 

Fig. 1 1 sets forth an example of a grep class used to implement the walking function. . 

50 ' ■ • . • . . . 

5. Archiving Service 

[0024] The URLs processed by the proxy 30 can be extended to include archive directives that add data to a stor- 
age repository e.g. device 1 50, and for retrieving the archived data. The new commands are intercepted and performed 
55 by the proxy server. Because a proxy is used as a middleman between the browser and the web servers, the new 
archiving services are just plug-in components and do not interfere with existing components and protocols. 
[0025] As an advantageous example, the URL naming scheme can be extended to include URLs in the following 
format: 
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http ://view@host/path 

where the "view" is a date, for example in the format yyyymmdd, when the corresponding page (i.e., http://host/path) 
has been retrieved from the original web server and stored into the archive repository. The timestamp can be used as 

5 the key to locate the page from the repository For example, http://19980701@www.att.conn/ would refer to the page 
http:/Avww.att.com that was retrieved and archived from the www,att.com web server on July 1, 1998. 
[0026] More advanced features can be implemented to allow specifying an action in front of the date for locating an 
alternative page on the archive server if the dated page does not exist. The system first locates the page archived on 
that date. If the desired page is not found in the repository the system then searches for the page in the repository 

10 before or after the date and returns the first found page. For example, the following syntax for naming archived pages 
can be used: 

httpy/[+| g]yyyymmdd[.hhmmss)@host/iDath 

15 Thus. http;//-Klate@host/path would choose the first page found after the specified date; on the other hand, http://- 
date@host/path points to the first page before the date. For example, http://+1 9980701@www.att.com points to the first 
page that was archived on July 1, 1998 or after, while http://-19980701@www.att.com is for the page archived on July 
1, 1998, or before. As shown in the syntax, the granularity of "view" can be readily taken down to the second level of 
hours, minutes, and seconds. 

20 [0027] The above naming scheme advantageously is compatible with the conventional URL protocol, which 
defines network resource naming as proto://[usert:password]@]host/path. For example, the URL 
ftpy/foo:bar@ftp.research.att.com/README points to a README page on the FTP server ftp.research.att.com, while 
accessing on behalf of the user foo with the password bar. The user/password portion of the URL protocol is undefined 
in the HTTP protocol; accordingly the above naming scheme can take advantage of this for archive naming. 

25 [0028] Multiple methods can be used to invoke the archive service and store data in the repository: 

Command Extensions . Using any of the methods described above under Section 1 . a user can invoke the archiving 
service. For example, the following URL: 

30 httpy/www.research.att.conViPROXY.html?iproxy&action=archive 

can be used to cause the system to archive the page 

httpy/www.research,att.conViPROXYhtml. 

35 

Scheduled Archivino. The system can also be extended to contain a server that executes an archiving task at a 
designated time, e.g. like cron command in Unix systems. The walking facilities described above can be used to 
"walk" through a web site for a set of HTML pages. As described above, the walking can be defined by a root URL 
and parameterized by (a) the depth of walking through hyper-references under HTML pages, (b) with or without 
40 image files embedded in HTML pages, and (c) walking through pages on the local web site or on all web sites. Fig. 
1 2 shows an example page interface for a cron eg! program which can be used to add a cron job to archive a web 
site. Users can schedule an archive task on a daily or weekly basis. 

Transparent Archivino. The system can support a function of archiving selected web pages whenever they have 
been accessed automatically The specification can be done through the CacheFlag of a cache command, which 
45 Specifies the caching policy: 

CacheFlag Archive URL-expression 

Whenever a requested URL matches the URL-expression, the system puts the data in the archive repository 
50 Archivino Browser Cache. The system can support a function for scanning data cached on a browser's cache area . 
and archiving them into the repository, 

[0029] As for retrieving information from the repository Fig. 13 shows how an example screenshot of an interface 
that can be used to browse the archived information. Each month's data of each website can be stored in a repository 
55 structure similar to a Unix-like pax archive. A cgi program creates a page on-the-f ly based on the contents of the archive 
and creates hyperlinks for each website name. The hyperlinks are listed for each month when the certain pages of the 
website were archived. For example, the AT&T website has a cron job to archive the web pages on a daily basis, so the 
data in Fig. 13 has all twelve months in 1998 listed as hyperlinks. 



EP 1 039 396 A2 



[0030] Multiple archive repositories can take advantage of the above-mentioned features for inter-proxy communi- 
cation to share the burden of storing the information. For example, Fig. 14 shows how multiple archive repositories can 
collaborate in the archiving task. Proxy server in Rg. 14 queries another repository in order to answer a user request. 
As shown in Fig. 14. the following advantageous web interface can be used to search the repository or repositories: 

£ 

http7/proxyhost/bin/iget/view@host/path 
A repository search path variable can be set using a command such as: 
10 RepositoryPath=Host:Port[:Host:Port]* 

Thus, multiple repositories may be easily addressed and accessed to quickly locate the desired information. 
6. Packaging Service. 

15 

[0031] A packaging service can be provided which would aWw the browsing of document pages from portable 
packages. The package is portable in that it can be possible to attach one to an e-mail or to copy one from one machine 
to another To create a package, the walking facility may be used to visit the sets of web pages that are designated to 
be packed. Thus, the system would accept (a) a root URL. (b) a parameter expressing the depth of the walking through 

20 the root URL's direct and indirect references, (c) an image option to decide whether or not to include the image files 
when walking through the web pages, (d) a reference filter option (for accessing all references or filtering out some of 
them), (e) mechanisms for storing cookies needed for accessing the root URL, and (f) a package name. The system 
then walks througl-; the set of web pages rooted by the designated URL and packs them into a package using the des- 
ignated name. The package can use any of the number of known conventional compression formats to package the 

25 data. The package is advantageously self-contained, including two physical files: one for contents and another for 
indexing. Each package can maintain its own index table. 

[0032] In order to brovyse the package, the proxy system can support f unctbris to access the web pages stored in 
the package as i?they were from the original web sites. The packages are stored on a local disk, and browsing does 
not require a network connection. When browsing, the server uses the above-mentionisd index table to locate corre- 
30 sponding content in the package. The server that generates the package may be different from the one that browses 
the package. The cookies used to traverse the web pages are automatically handled by the system. 
[0033] New documents can easily be appended to an existing package. A single package may, in fact contain more 
than one root URL Each root URL in the package can be chosen as an entry point to browse the package. 

35 7. Personalized Services 

[0034] tt is notable tat the proxy system described above can have access to a user's private information such as 
the web access history and sensitive financial information. A user may not be comfortable with providing this informa- 
tion to a server across the communication network. The same information can be stored in a safe location locally, on 
40 the client machine where the proxy has been integrated on the client-side or on a local centralized proxy closer to the 
user. The present invention permits several new personalized services to be provided. 

[0035] The proxy can be used to integrate in an automatic manner the information provided by a typical portal with 
sensitive personal information. For example, a user issues a request for the following URL: 

45 httpy/www.att. net/?iproxy &action=portal 

The portal command would cause the proxy server to retrieve the home page from www.att.net, which has been 
encoded with scripting directives that instruct the proxy server how to process the local data and merge it with the 
server contents. It then presents the personal portal page back to the user. In order to provide scripting that is non-intru- 

£0 sive to other users who are not using the pi'esent invention, the scripting directives can be embedded in HTML com- 
ments as shown in Fig. 15. The proxy server intercepts the directives in Fig. 15 and performs the necessary actions 
before returning the sewer portal page to the browser. All the directives, being embedded in an HTML comment, are 
ignored by browsers not using a proxy sewer configured in accordance with the present invention. 
[0036] The following are some illustrative examples of how to use the capabilities of personalizing information 

55 retrieved from the public servers. They are merely examples ard are not meant to limit the nature of the present inven- 
tion: 

Personal Web Paoe Reminders and Hot Sites. Since the proxy server can log a user's web accesses, it can analyze 
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the log and use the data to provide new web services that can improve the user's browsing experience. Fig. 16 
shows, for example, two possible services: (1) "TO-READ" homepages. A user can specify a list of websites and 
corresponding frequencies when certain websites should be visited. The proxy can check the last visiting dates and 
schedule a list of pages that the user should visit today. (2) "HOT Sites." The proxy sewer can conpute the number 

5 of visits to each website and list the top ten websites with their last visiting dates accordingly as soon as the user 
accesses his/her personal portal. There are several advantages of having such a list. The user may want to know 
the last visiting time of a favorite site - the timestamp can be displayed along with the website link. The user may 
wish to access the latest version by clicking on the link. The user may wish to compare the new version with the old 
using some differencing tool, especially since the previous versions of the web page can be archived as described 

10 above. Fig. 15 shows the directives used to construct the page displayed in Fig. 16. The directive "to-read" con- 
structs a list of web pages scheduled to be read; the directive "dolog" analyzes the current web access log to pro- 
duce the statistics need for the next directive, "top 1 0" which presents the results on the personal portal. 
Personalized Financial Page. Most portals currently allow users to specify the stocks that they are interested in and 
display the latest stock price when a user accesses the personalized page. See Fig. 1 7 which shows a typical AT&T 

15 WorldNet portal showing various stock quotes. However, the portal cannot compute your current balance or net 
gain/loss unless you provide private and sensitive information like how many shares you own and when you pur- 
chased them. Most users would not like to provide such information to their porta! page server In accordance with 
an embodiment of the present invention, such personalized information such as real purchase price, commission 
fees, and the number of shares of each stock can be stored and accessed by the proxy server By constructing an 

20 output filter for the stock page, the proxy server can retrieve the private information, combine it with stock quotes 
provided by the portal site to compute the balance, net gain/loss, and other interesting personalized informa- 
tion/statistics. Rg. 18 shows the same view as Rg. 1 7 personalized with the user's information. This can be accom- 
plished by a specification like the following in the proxy configuration file: 

25 OutputRlter /binyportfoliccgi http://stocks.planetdirect.com/portfolio.asp 

This instructs the system to apply the Java class "portfolio" as an output filter vyhenever the browser issues the cor^ 
responding http request. The numbers in Fig. 18 are visible only to the client and not the original portal server The 
user is shown as having bought 267 AT&T shares. 50 Netscape shares, and 40 E*Trade shares at the respective 
30 prices of $36.50, $21.0, and $39.38. each. The commissions were 0, $19.95, and $19.95. The total gain was 
$1 7.799.02. The numbers replaced by the proxy server are shown in a different shade. 

Personal Web Archive. While current search engines allow users to find pages of a certain topic easily, they do not 
offer much help in looking and viewing the pages a user has seen in the past, except for those that are still kept in 
the browser cache. Due to the sharp decrease in storage costs, a client-side proxy can afford to archive all the web 

35 pages a user has seen so that any of these pages can be retrieved easily later on - without even bookmarking them. 
Existing webpage search tools such as /Vita Vista Discovery can be used to index the web archive and search the 
pages. A user can then quickly conduct a search of all pages he/she has seen in tiie last year, for example. /\s 
described in the archiving section above, the instant system can intercept http requests and effectively extend the 
URL name space to address pages stored in the archive by adding a timestamp m front of the regular http address. 

40 Even as the web pages go through major redesigns, the original pages can be accessed using the archive exten- 
sions to give the same content. 

[0037] The foregoing Detailed Description is to be understood as being in every respect illustrative and exemplary, 
but not restrictive, and the scope of the invention disclosed herein is not to be determined from the Detailed Description, 

45 but rather from the claims as interpreted according to tiie full breadth permitted by the patent laws. It is to be understood 
tat the embodiments shown and described herein are only illustrative of the principles of the present invention and that 
various modifications may be implemented by those skilled in the art without departing from the scope and spirit of the 
inv ntion. For example, the detailed description has been described with particular emphasis on the Internet standards 
of HTTP, URUs, and HTML. However, the principles of the present invention could be extended to other protocols for 

50 sending information from a server to a client. Such an extension could be readily implemented by one of ordinary skill 
in the art given the above disclosure. 

Claims 

55 1 , A method of providing access to information stored at a server comprising the st^s of: 

establishing a document serving protocol channel to a server; 

receiving a document from the server via the document serving protocol channel; 
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retrieving local information; 

customizing the document to reflect the local information before transmission of the document to the user. 

2. The method of claim 1 wherein the customizing step is based on scripting commands embedded in the document. 

3. The method of claim 1 wherein the customizing step is based on a filter which specifies which documents retrieved 
from which servers should be customized and how they should be customized. 

4. The method of claim 1 wherein the local information is stored on a local storage device. 

5. The method of claim 1 wherein the local information is private user information. 

6. The method of claim 1 wherein the local irrformation is user access information. 

15 7. The method of claim 1 wherein the document serving protocol is the hypertext transfer protocol. 

8. The method of claim 1 wherein the document is a web page. 

9. The method of claim 1 wherein the server is a web server. 

20 

10. A computer readable medium containing executable program instructions for performing a method on a computer 
connected to a communication network comprising the steps of: 

establishing a document serving protocol channel to a server; 
25 receiving a document from the server via the document serving protocol channel; 

retrieving local information; 

customizing the document to reflect the local information before transmission of the document to the user. . 

.11. The computer readable medium of claim 1 0 wherein the customizing step is based on scripting commands embed- 
so ded in the document. 

12. The computer readable medium of claim 10 wherein the customizing step is based on a filter which specifies which 
documents retrieved from which servers should be customized and how they should be customized. 

35 13. The computer readable medium of claim 10 wherein the local information is stored on a local computer readable 
storage device. 

14. The computer readable medium of claim 10 wherein the local information is private user information. 

40 1 5. The computer readable medium of claim 1 0 wherein the local information is user access infornnation. 

1 6. The computer readable medium of claim 1 0 wherein the document serving protocol is the hypertext transfer proto- 
col. 

45 1 7. The computer readable medium of claim 1 0 wherein the document is a web page. 

18. The computer readable medium of claim 10 wherein the server is a web server. 

1 9. The computer readable medium of claim 10 wherein the network is the Internet. 

20. A proxy server comprising: 

a first interface for establishing a document serving protocol channel to a server; 
a second interface for establishing a second document serving protocol channel to at least one client: 
a storage device for storing local information; 

a processor adapted to customize documents received from the server with the local information before trans- 
mission back to the user. 
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21 . The proxy server of claim 20 wherein the customizing step is based on scripting commands embedded in the doc- 
ument. 

22. The proxy server of claim 20 wherein the customizing step is based on a filter which specifies which documents 
retrieved from which servers should be customized and how they should be customized. 

23. The proxy server of daim 20 wherein the local information is private user information. 

24. The proxy sender of claim 20 wherein the local information is user access information. 

25. The proxy server of claim 20 wherein the document serving protocol is the hypertext transfer protocol. 

26. The proxy server of claim 20 wherein the client is a browser. 

27. The proxy server of claim 20 wherein the document is a web page. 

28. The proxy server of claim 20 wherein the server is a web server. 
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FIG. 2 
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FIG. 3 



System Command 


Description 


reset & resetall 


Reset the system. The system wfll reload the external 
configuration, file and reset to the initial state. 


conneci=I0n|Off] 


Run the system as on-line mode (On) or ofWine mode 
(Off). For the ofMine mode, the system woni create 
"Agent Thread*' for retrieving web pages, instead; it 
responds to the requests with local cache files and 

Ions fhn^p renupstfi ih;)t can not find nanefi in the' 

cache. • 


setnet=netid 


Switch the network to a new one 'netid''. This feature 
is used when the user is using more than one dial -in 
network for internet acc^. If netid does hot match 
the id in the control.file, the system \mII call a CGI -bin 
b dial*in a different nebirork. 


dns=dnsjerver 


Create a DNS agent.on the local host. It then fonx^ards 
k)cal DNS requests to dns server. 


forw)rd=loaclport.rtiostrpoiH,pfpxyhost: 
port) 


Create a TCP forwarding service. Connection to 
localport will Ijie mapped to rhostjport, and traffic to 
the former will 1)6 forwarded to the latter. This 
command uses 'SSL proxy" protocol to connect to 
proxyhostipbrL 


pasv=fhostrport 


Create a passive ohannel to another server (running 
on rhostrport)! 


htwalk= l6vel|, -optionf (funclion[=argsil* 


level: specif the depth of hyper reference hierarchy 
the system Will walk down, 
option: options include: (a). Retrieving image files 
(image) or not fno/maae);(b).Accesslnaoniy local 
pages (/oac9 or any Web pages Yg/oba/j. . 
ftinction: the javabin function that is called for each 
visited page.' 
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FIG. 4 



iPROXY Page Shell - Netscope 



□MO 



file Edit View Go. Communicator Help 
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Q 


a. 
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Back 


Forward 


Reload 


Home 


Search 


Netscape 


Print 


Security 


stop 



2a 



Bool<marl<S ^Location: I http://inlerQdive.wsi.com/pages/fechmonr A What's Related 



(Toolbar) Cll(Search}C^l (Business) C!)(Computers)Cf) (Entertainment) C:^(News) 



{Preference ! fCache Archive } iBrowsino Coche j {Browsina Archive j {Scheduling } 

iPROXY Page Shell 

• Walking HTML 
URL i http://interocfiye.wsi.com/poges/techiTion 



Depth: 11 level |V 
Option: I Idcol |V| (With imoge |V 



Press l -Htwclk | to prefetch pages linked. 



• Press I Archive I to put wolked pages into archive, 

• Press Seorch | tosiBorch |~ 



keyword. 



• Press I ToGo i to put walked pages into j '^pqg" I catogory. 
• Change Cache Policy 



URL pattern: j http://interoctive.wsi.com/poges/techmon 



Cache Flag: I On Iv 
• Press I OK I lo odd a coch flog entry. 

. Change Cache ValidTlme 
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FIG, 6 



HeaderFilter 



ORIGINAL 
REQUEST 

BROWSER 



DOCUMENT 
GENERATED BY 
OutpuiFilter 




REQUEST WITH 
NEW HEADER 

1 



Outputr[lter 

V 





ORIGINAL 
PAGE 



WEB SERVER 



CACHED 

nlE 



InpufFilter 

CACHED PAGE 
PROCESSED BY 
Inpiitniter 
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FIG. 7A 

public class inputFilterSample extends javabin \ 

public Object Execute(OutputStream os.Hoshtable ht)throws lOExcepfion \ 
String uri = (String)tit.get("urr); 
String (name = (String)ht.get("patti"); 
byte orig_date[] = readCactieFile(fname); 
byte r€sult_data[] = dolnputFilter(orig_data); 
writeCacheFile(fname, result.data); 

I 

• 



FIG. 7B 

public class outputFilterSample extends javabin | 

public Object Execute(OutputStream os.Hashlable ht)throws lOException { 
String uri = (String)ht,get(''uri"); 
String (name = (String)tit.get("patti''); 
byte cactied.date[] = readCacheFile(fname); 
byte result_data[] = doOutputFilter(orig_data); 
os.write(result_data); 

\ 

• 

I 



FIG. 7C 

public class headerFilterSample extends javabin | 

public Object Execute(OutputStream os.Hashtable ht)throws lOException | 
String orig.tieader = (String)ht.gef(''hf.tieqder"); 
String result_header = doHeaderFilter(orig_tieader); 
os.write(result_header.getBytes()); 

1 

I 
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FIG. 8 



statement 


Description 




Null statement, as comment 


■:if exp" .. .'lelseif exp" _ 'lelse' ":endir 


Conditional statement TTie fomnat of 'exp' is 
■str1=str2"or"strf1=sti2'. 


":reser 


Reload configuration and restait the proxy 
sendees. 


'ihtwalkurlargumenr 


Execute an HTML setwalklnq immediately. 




Create a TCP fonvardina channel. 


"ipasvhostporf 


Connect another pn»^ server and build a 
passive channel. 


':block dass.name arglisr...':endbiocK' 


Invoke iavabin.da5s name (with statements.) 


':javabin class name arglisf 


Invoke a javabin.class name. 


*2ip file filename'& ':unzip dumpfilename* 


Compress/decompress an file. 


ictrimacth var Ctrl -type' ..."lendctrT 


Match the entries with drl^type in ctrifile.txt and 
store in ${var.ki}, ${var.type), $(var.arg). and 
$(var.uri) variables. 


rctrtadd clri_type ctrt arg cti1_url'' 


Add a new entry of ctrifile.txt 


:ctridelete selected 


Delete the entries whose Ctrl id Is assigned in 
arguments. 


:cronmatch var„. "lendcron" 


Match the entries of scheduling and store in 
${var.id), ${var.hour), $(var.wday), ${var.cmd), 
${var.ur1), and $(var.arg) variables. 


:cronadd hour wday cmd uri walk level aiglist 


Add a new entry of scheduling. 


":crondelete selected" 


Delete the entries whosecron_kl is assigned in 
arguments. 


:sysinfovar 

(Iforward 1 iagentrihtwalklthreads)" ... 
:endsys' 


List the system infonnation. 
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FIG. 10 



r 1 

IProxy Main Thread (ipmain) 




Hfml Parsing Walking command 

Hyper Reference Riter 




Htwolk 
check 
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FIG, 11 . 

public class htwalkGrepSample exents javabin | 
public void initProcQ { 
// init process 

} 

public void finolProcO \ 
II final process 

public Object Execute (OutputStream os.Hashtable ht)ttirows lOExcepfionj 

initProcQ; // init process 
String titcmd = (String)lit.get{"htcmd"); 
String uri = . (Strin9>t.get("url"); 
String args = (Strin g)ht.get{"args"); 
String fname = (String)ht. get( "path"); 
String key = (String)ht.get("walkopt"); 

finajProcO; // final process 

if (keywordMatctied(fnorne, key)) { 

StiowGrepResult(url, fname); 
I 

{ 
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FIG. 12 





Cronlab Configuration- Neiscape - [5^ Xj 


File Edit View Go Communicator Help 


E^Bookmorks ^Location: |http://localhost/iproxy/cronfob.cgl | ^What's Related 


Scheduling Future Tasks 


m 
-| 




The Cron fable 






• Delete Entires: 






1 1 http://wyw.Qttxom/,hbur tOMre€kdoy',ActIon''WALK 






GJocaljmag6.orchfve 






Press Delete | 1o delete ttie checked items(s) 






• Add 0 new entry 






Reteive hour list: |12 Lfeq,:'8,12.16 or for everyhour) 






Reteive weekday: |» 1 (eq.:'1.3,5. or for everyday ) 






Location: Ihttp:// I 






Walk Depth: {Single URL V 






Walk Option:! locol V I With image |vl n Archive 






Press \ OK 1 to add a cron table entry. 
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FIG. 13 



Archived Usl Root - Netscape 
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Archive in 1998 , 
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FIG. 15 
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FIG, 16 



1 — 1 


- Crontab Configuration- Netscope 




file Edit View Go Communicator Help 
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TO-READ HOMEPAGES HOT ITES 

1. hffp://w ww.opple.com/ [todoy] 1. htfp://www.Qff.com/ 

Mon Aug 03 05:32:17 EOT 1998 Thu Jul 15 12:03:05EDT 1998(2247) 

2. http://www.ott.com/ [todoY] 2. http://ed.doubleldck.riet/ 

Sun Nov 01 00:32:12 .EOT 1998 Thu Jul 15 10:08:58EOT 1998(1010) 

3. htfp://www.jbQn.com/ ffodoy) . 3. htfp:// www.cspon.com/ 

Sun Nov 01 00:35:46; EOT .1998 Thu Jul 15 10:68:58EDT 1998(854) 

4. http://www.intel.com/ [today] 4. http://www.(iltQvista.com/ 

. Mon Aug 03 03:22:43 EOT 1998 Thu Jul 13 10:09:31 EOT 1998(817) 
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7. http://www.sun.com/ [todoy] - 7. http://www.seQrch.ott/ 

Mon Aug 03 03:23:40 EOT 1998 Thu Jul 15 12:08:32EDT 1998(247) 

8. http://image2.anytime.com/ 
Thu Jul 08 00:03:53EDT 1998(151) 

Press here to list homepages or here to edit 
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FIG, 17 
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